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■J  ABSTRACT 


S. 


Consider  the  model  of  multiple  superimposed  exponential  signals  In 


additive  Gaussian  noise 


Jj-Ja  ,  ,)  jo  ^ 


n. 


Yj(t)  "  iI1s ijfi  + 


t  =  0,1 


,n-l ,  j  =  1 ,. . .  ,N 


where  N  is  fixed  and  n  ■+  »,  X.  *  exp(/=l(J^),  e  [0,2ir),  i  =  l,...,p, 


s^  are  unknown  parameters  and  p  is  known.  Further,  ( t )  =  e ^ ^ ( t ) 


+  ^e^t),  and  e^ft),  e^U)*  t  =  0,1,2,...,  j  =  1,...,N,  are  mutually 


independent  and  identically  distributed  real  random  variables  with  a 

2  2  2 

common  distribution  N(0,o  /2),  0  <  a  <  ®,  a  is  unknown.  It  is  shown 


that  if  u.j  1  oij  when  i  f  j  and  Ij=-|lsijl  >  0  for  i  =  l,...,p,  then  the 


Maximum  Likelihood  estimate  (A^,  ....  Ap)  is  strongly  consistent.  More¬ 
over,  it  is  shown  that  A^  converges  to  with  an  exponential  rate. 


AMS  1980  subject  classifications:  Primary  62F12;  secondary  62H12. 

/.'■  r)  'Ar  , 

Key  words  -end  phrases:  -consistency,  exponential  rate.  Maximum  Likelihood 

estimate,  signal  processing. 

/ 


Research  sponsored  by  the  Air  Force  Office  of  Scientific  Research 
under  Contract  F49620-85-C-0008.  The  United  States  Government  is 
authorized  to  reproduce  and  distribute  reprints  for  governmental 
purposes  notwithstanding  any  copyright  notation  hereon. 


2 


1.  INTRODUCTION 

Consider  the  following  model  of  multiple  superimposed  exponential 
signals  in  additive  Gaussian  noise 

P  t 

YjU)  =  +  ej(t),  t  =  0,1 . n-1 ,  j  =  l . N  (1) 

where  =  exp(y/::luj^),  i  *  l,...,p,  wj  e  [0,2ir),  ,  s^  are  unknowns 

and  p  is  assumed  to  be  known.  Further,  e^  (t)  =  e^t)  +  /Oe^t)  and 

e.j(t),  e^t) ,  t  =  0,1.2,...,  j  =  1,...,N,  are  mutually  independent 

and  identically  distributed  (iid.)  real  random  variables  with  a  common 
2  2  2 

distribution  N(0,a  /2),  0  <  a  <  «,  a  is  unknown. 

Quite  a  number  of  papers  appeared  dealing  with  the  estimation  of 
parameters  in  this  model,  which  is  important  in  problems  related  to  sig¬ 
nal  processing  and  time  series  analysis.  When  Xj,  ....  Xp  are  known, 

(1)  reduces  to  an  ordinary  linear  regression  model  in  which  s.  .'s  are 

*  J 

usually  estimated  by  the  Least  Squares  method.  Therefore  a  conceivable 
way  to  handle  the  estimation  problem  in  (1)  is  as  follows:  Obtain 

A  A 

by  some  way  an  estimator  ( X-j ,  ....  Xp)  of  (X-j,  ...,  Xp).  Substitute 

A  A 

Xi  for  X.  in  (1),  consider  the  x^'s  as  known  constants  and  use  the  IS 
method  to  yield  an  estimate  for  s. ..  This  seemingly  reasonable  procedure 

*  J 

has  the  drawback  that  the  estimate  of  s..  thus  obtained  is  usually  non- 

•  J 

consistent,  as  indicated  in  [1], 

For  the  more  important  problem  of  estimating  X-j . xp,  several 

methods  have  been  proposed  in  the  literature.  Bresler  and  Macovski  de¬ 
rived  in  [2]  the  LS  criterion  in  the  form  of  minimizing  some  function 
not  involving  s^j.  Under  the  normality  assumption  here,  it  is  the  same 
as  the  Maximum  Likelihood  criterion.  Their  method  consists  in  introduc- 


\  7V1AA  HJ\  HAAA  M 


w,:,  w*.  w 


3 


1 


1 


g 

$ 

v! 


ing  a  polynomial  bQ  +  b^z  +  ...  +  bpzp  having  X-j,  ....  xp  as  roots, 
thus  reducing  the  problem  of  estimating  x.j . Xp  to  that  of  estlmat- 

t 

ing  the  coefficient  vector  b  ■  (bg,  ...»  bp)  ,  Specifically,  define 


the  set 


Jb:  j^b,!2  -  1.  bp  >  o| 


and  the  (n-p)xn  matrix 


B  (b)  = 
n  *•' 


b0  bl  *  *  *  bp 

bO  bl  *  *  *  bp 


•  «  •  •  • 


bg  bl  • 


.  b. 


,  O) 


Dn(b)  s  B„(b)B*(b), 
n  «  n  -  n  • 

where  B*(b)  denotes  the  conjugate  transpose  of  Bn(b).  Also, 

Y(j.n)  =  ( Yj(0) ,  Yj(l ) . Y^n-l))’,  J  "  1 . N 

Qn(Y,b)  *  I  Y*(j,n)B*(b)D’1(b)Bn(b)Y(j,n)  (4) 

j — 1 

Bresler  and  Macovski  showed  in  [2]  that  the  vector  b  *  b(n)  minimizing 


Qn  on  B,  that  is  to  say. 


Qn(Y,b)  -  min  Q  (Y,b) 
n  £eB  n 


is  the  ML  estimate  of  b^  *  (b^ ,  ...»  bp^)'  e  B,  where 

bg0^  +  bj0,z  +  ...  +  bp°^zP  «  0, 


ns 


v  *y  *  y  jc* 


has  roots  ....  Ap.  Bresler  and  Macovski  suggested  an  iterative 
process  to  compute  b.  No  proof  is  given  for  the  convergence  of  this 
process.  Nor  is  one  guaranteed  that  when  the  process  does  converge,  the 
limit  is  indeed  an  overall  minimizing  point  of  Qn,  and  not  a  local 
minimum. 

Theoretically  it  is  interesting  to  give  a  close  study  of  the  statis¬ 
tical  properties  of  the  ML  estimate  b.  For,  although  the  ML  method 
usually  gives  statistical  procedures  with  satisfactory  performance,  in 
particular  when  the  normality  assumption  is  in  force  as  here,  the  com¬ 
plexity  of  the  model  (from  the  point  of  view  that  the  unknowns  of  the 
model  appear  in  rather  complicated  expressions)  makes  it  unclear  how  good 
the  ML  estimate  is  under  the  present  situation.  As  mentioned  earlier, 
under  model  (1)  the  ML  estimate  of  s . .  is  not  even  consistent.  So  also 

*  J 

the  good  performance  of  the  ML  estimate  of  (A^,  ....  xp)  cannot  be  taken 
for  granted. 

This  paper  is  devoted  to  a  basic  problem  of  the  asymptotic  theory  of 
the  ML  estimate  of  (x^  ...,  xp)  -  its  consistency.  On  reducing  the 
problem  to  the  estimation  of  b^  as  described  earlier,  it  is  seen  that 

*  A 

the  problem  is  equivalent  to  the  consistency  of  the  ML  estimate  b  =  b(n) 
of  b^.  Our  main  result  is  the  following  theorem: 

THEOREM  1.  Suppose  the  following  conditions  are  satisfied: 

1.  |x1|  =  ...  =  |x|  =  1,  A.  f  A.  for  i  f  j. 

2.  For  each  k  =  l,...,p,  ^  j=i  I  skj  I  51 

3.  { e . ( t ) }  satisfies  the  conditions  elaborated  at  the  beginning 

3 

of  this  section. 

Then  for  arbitrarily  given  e  >  0,  there  exists  constant  c  >  0  inde- 
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pendent  of  n  such  that 

P(||b(n)  -  b(0)||  >  e)  <  e"cn  (7) 

for  n  large,  where  ||a||  denotes  the  Euclidean  length  of  the  vector  a. 
(7)  entails,  in  view  of  the  well-known  Borel-Cantelli  lemma,  that 

^  A  (  0  ) 

b  =  b(n)  is  a  strongly  consistent  estimate  of  b  . 


Some  facts  concerning  mainly  with  the  matrix  D  (b)  will  be  needed 

n  - 

in  proving  the  theorem..  For  convenience  we  shall  write 


m  =  n  -  p„ 


LEMMA  1.  For  any  b  e  B,  we  have 


Dn1(6>  ipTT'm- 


D-’(b)  <  2-P(P+1)(p+i)pn3(P+1>  I., 


where  I  is  the  identity  matrix  of  order  m. 

Proof.  (9)  follows  from  tr^Bn(b)B*(b)j  =  p  +  1. 
To  prove  (10),  we  proceed  to  find  the  minimum 


H  =  min  min  u*D  (b)u 
beB  ueA  ~  n  ~  “ 


where 


A  is  the  set  (u  =  (uQ,  ....  u^)':  I^J|ui|2  =  1} 


Introduce  the  (p+l)*n  matrix  U*(u): 


u*(u)  - 


u0  U1  • 


1  • 
m- 1 


uo  ui  •  •  Vi 


Uq  u^ 


.  u 


One  sees  easily  that 


u*B_ ( b )  =  b'u*(u). 


7 


N 

1 

|Vi» 

\V 


■tV 

*>*• 

$ 

0 


(’iir 

$ 

I 


Hence, 


u*D  (b)u  =  b'V(u)b,  V(u)  =  U*(u)U(u) 

*  n  *  •»  %  w  m  mr  tm  m 


H  =  min  min  b'V(u)b. 
ueA  beB 

Now  we  prove  that  for  any  u  e  A,  we  have 


det  V(u)  >  2p(p+1)n"3(p+1)  . 


Since  (13)  is  true  when  p  =  0,  suppose  that  p  >  1  and  n  >  p  +  1  >_  2. 


Define 


fn(x)  =  u0  *  u,x  ♦  ...  ♦  V,x 


and  ui  =  exp(/^T  27r/n) ,  n  =  (w,  u>  ,  ... ,  wn}.  There  exist  at  least  p  +  1 
elements  uj ,  . Wp+|  in  n,  such  that 

lfn(“k)l  -  n_(p+1).  k  *  1,2 . p+1.  (14) 

Indeed,  supposing  in  the  contrary  that 

♦i,  e  a,  |f  UJ|  <  n‘^p+1^,  k  =  1 ,  ,n-p  (=m),  (15) 


then,  on  putting 

Q  (4>i»  =  ^m+i»  •••» 

A*  (1,2,..., ml,  A1  -  {m+1 ,  ... ,  n}, 
and  using  Lagrange  interpolation  formula,  we  have 


fn(e'Cr0)=  I  W  » 

n  j=i  n  J  keA-{ j : 


(e  "le  -  $.)/  n  (<(,.  -  #.) 
V  keA-{ j }  J  K 


E 


For  fixed  j  e  A,  we  have 


n  U,-k)  n 

-m  J  K  kPA.  J  * 


xn-l 


keA-{j) 


Hence, 


n  4;  -  ^  n  (♦.  -  ♦. )  <  2p/n. 

-fU  J  K  0  ,Va  A.  J  K  - 


|keA-{j} 


Two  cases  are  possible:  First, 


|e  -  arg  $k|  >  */n  (mdd2n),  k  e  A^U). 


In  this  case  we  have 


yrr  a  i  _  P+  • 

n  (e/  -  )  >  sin- 

keA^Ul  * 


•  o  _  p 

Since  sin  -  >  —  ~  =  -  when  n  >  2,  we  have 
n  —  n  n  n  — 


n  (e*^" ®  .  )  ▼  e 

keA-{ j } 


/T  ne 


n  (e 

keA-,ut  J  > 


/^T  e 


«  2|s1n  il'1”1  <  2-P„P+'. 


Second, 


e  -  arg  $  |  <  ir/n  (mod  2w) ,  for  some  i  e  A^uU)- 


(Note  that  there  are  at  most  one  such  £.)  In  this  case,  noticing  that 
| e  -  arg  $k|  >.  w/n  (mod  2w)  for  any  k  e  A-jUU}.  k  /  i,  and  that 

|e*/-Tne  _  i  j  / 1  0  -  $  |  _<  n,  we  have 


LT 


ra',5Vn 


i&k 


I *en-v J  ) 


1 1 keA^uf j  > 


* 


<  n 


keAjtjCj},  kj<£ 


(e^e  -  $k)  [ 


<  "(sin  £)  °  <  2"pnp+1. 


all  0  e  f — 7i » 7i ) 


n'  — 

From  (15)-(19) ,  we  obtain 

Jfn<e'^Te)[  <  nn-'^'^zPn-’jrV  .  1.  for 
Therefore, 

m-1  .  .  tv 

J0|uji  -sr|  <  i. 

-n 

contradicting  the  fact  that  I jZq 1 0 j 1 2  *  >•  Th1s  Proves  (14). 
Now  put  (remember  that  u  =  2*/n) 


p+l}j- 


“1  n""l'  2  n'  2'  *  *  *  "p+rn'Vl 


W2*V“2^ 


{+lfn(Vl 


VJ 

•M 


U*(u)U(u)  =  1  U*(u)GG*U(u)  -  I  FF*  »  1  F,F?. 
-  n  -  -  n  — nil 

det  V  ( u )  »  det(u*(u)U(uj)  >_  n“^p+1  ^  |det  F,|2 


n-(p+l)Pn  f  (  ) 


n  lx.  -  w 


>  0-(P*l)0-2(P*l)2|s1n  -I  P(pi,) 

—  i  n  ] 

t„-(p+l)„-2(pt!)2(£)p<p*')  .  2P(p+l)0-3Cp+T)Z 


V  *  Y  A 
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and  (13)  is  proved* 

Denote  by  L(u)  and  fi. ( u )  the  largest  and  smallest  eigenvalue  of  V(u), 
«*  «*»  ** 

respectively.  Obviously  we  have  L(u)  £  p  +  1,  for  any  u  e  A.  From  this 
and  (13) ,  we  have 

l(u)  lCpn-3(P+1>2,  cp  =  2',<P+’)(p*l)'P. 


From  this  and  (12),  we  obtain 


H  —  Cpn 


■3(p+l )‘ 


(20) 


Now  denote  by  dn(b)  the  smallest  eigenvalue  of  Dn(b).  By  (11), 

(20),  we  see  that  dn(b)  _>  C  n"^^  ,  for  any  b  e  B,  which  amounts  to 
the  same  thing  as  (10).  Lemma  1  is  proved. 

LEMMA  2.  For  arbitrarily  given  h  >  0,  there  exists  h-.  >  0  such  that 

-h, 

for  any  beB,  beBwith|b-b|j<n  ,we  have 


! D”1 (b)  -  D“ 1 ( b ) |  <  n~h ,  n  >  n 


0 


(21) 


for  some  n^  not  depending  on  b,  b.  Where  for  any  vector  or  matrix  C, 
I  Cl  denotes  the  maximum  module  of  the  elements  of  C. 


Proof.  Since 

D‘](b)  -  D’1  (b)  =  D"1(b)(Dn(b)  -  Dn(b))D‘1(b), 

(21)  follows  easily  from  Lemma  1. 

o 

In  the  following  we  use  y  (<5)  to  denote  the  noncentral  Chi-square 

distribution  with  degree  of  freedom  n  and  noncentrality  parameter  6. 

2  2 
x  (0)  will  be  abbreviated  to  xp- 


■Mi 


LEMMA  3.  Suppose  that  {£  }  is  a  sequence  of  random  variables, 
2 

£n  is  distributed  as  Xp(5n)»  and  there  exists  positive  constants 


n-j  1  n2  suc^  that 


r)| n  ^  ^  2  n ,  n  1 , 2 , •  *  § 


Then  we  can  find  positive  constant  c  independent  of  n,  such  that 


P{Cn/n  >  1  +  n-j/2)  >  1  -  e~  ,  n  =  1,2,,.. 


Proof.  We  can  find  random  variables  £  ~  x^,  Z  -  N(0,1),  such  that 
Cn  is  distributed  as  £  +  26nZ  +  6^.  Choose  e  e  (0,  n1n2‘1/2/8) ,  we  have 


P  ( |  Z I  ^  e  /n )  <_ - exp  ( -  ^— )  £  e  1 

ym  -zt'rT 


2  2 

for  c^  =  e  /2,  n  >_  2/(rre  ).  But  when  |Z|  <  e/n,  we  have 


1 2 6 ^Z [  <_  2/n^En  ^  n-|n/4. 


Therefore, 


P(cn/n  >  1  +  n-|/2)  >  P(c/n  >  1  +  n-,/4)  -  P(|Z|  >  z/i\) 

-c.n  ? 

>  1  -  P(  I  C/n  -  1 1  >  n1/4)  -  e  1  ,  n  >  2/e\  (23! 

2  2 

Since  £  is  the  sum  of  iid.  variables  Xn,  with  -  N(0,1),  in 

2 

view  of  the  fact  that  X-j  has  moment  generating  function  in  some  neigh¬ 
borhood  of  zero,  it  is  well-known  ([3],  p.288)  that  there  exists  a  con¬ 
stant  c2  >  0  such  that 

-c^n 

P(  |  c/n  -  1 1  >  nj/4)  ^  e  ,  for  n  >_  n^ . 

From  this  and  (23),  we  see  that  (22)  holds  for  c  =  min(c-|,c2),  when 
2 

n  >  max(2/e  ,  n^).  Replacing  c  by  some  smaller  quantity,  we  can  make 
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3.  PROOF  OF  THE  THEOREM 


Introduce  the  following  notations: 


Sj  =  (s^j,  ....  Spj)',  wk(b)  =  b0  *  b,xk  +  ...  +  bpib. 


x"’1  x"-1 


a2(n,b)  = 

J  * 

For  simplicity  of  writing  and  without  losing  generality,  suppose 
2 

that  o  =1.  Then  from  the  assumptions  imposed  on  {e.(t)},  we  have 

yJ 

Qn<’M>)  '  4Js2(n-.b)J  • 

Remember  that  m  =  n  -  p.  From  (9)  and  the  fact  that  | x i |  =  | I  =  ... 


|  Xp  j  =  1 ,  we  have 


>  i  N  n  1  N  m-1  p  . 

(n,b)  >  -ly  T  | B  (b)A  s .  | 2  =  -jy  y  y  |  y  ^kwk(-b)s 

p  1  j=1  n  n  J  p+i  j=1  t=0  k=0  k  k 


N  m-1  P 


2  _  ,2 


n+T  1  -  -  I  |W,  (b)  p  s.  . 

P+1  ( j  =  l  t=0  k=l  k  -  ‘  kJ 


P  N  m-1  .  [ 

+  l  l  H^u\)  w u(b)w  (b)s  ,s  .  . 
uA  j=l  t=0  u  u  “  v  -  vjj 


By  assumption 
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V 

y 


C 


y.; 


a  =  min{  l  |s.  .|  :  k  =  l,...,p}  >  0. 


Hence, 


N  m-1  P 


I  l  l  Iwk(b)r|skir  >  a(n-p)  l  |w.(b)|S  (25) 

j=l  t=0  k=l  K  KJ  k=l  k  ~ 

Put 

s  =  max{ [skj I :  1  <  k  <  p,  1  <  j  <  N}, 
x  =  mi  n  { |  x .  -  X .  | :  1  <_i  <  j  £p}„ 

^  j 

We  have  X  >  0  since  by  assumption  X.  1  x.  when  i  f  j.  Thus 

1  J 

1  _  4-  O 

l  (x„  x„)  1  TT  ’  n  >  p  +  1 ,  u  t  V, 

t=0 

Therefore,  noticing  that  | ( b )  |  <_  /p  +  1 ,  we  have 

P  N  m_1  _  t  _  9  9  i 

I  l  Hx  x  )  w  (b)w  (b)s  .s  .  <  2p^(p  +  l)Ns^(l -x)'1,  (26) 

u?v  j=l  t=0  u  v  u  ~  v  -  VJ 

Define  the  set 

Be  =  [  -  :  -  =  ( bQ  ’  °  »  bp ) '  e  B»  ^  lbk  "  bk  ^  -  G]* 

Since  {X.j ,  .. . ,  x  }  is  the  set  of  all  roots  of  b^  +  b^Z  +  ...  + 

b(0)^P  _  is  easiiy  seen  tbat 

inf [  ;  j w. (b) | 2  :  b  e  B  I  >  0.  (27) 

'  k=l  k~  “  ei 

Sunrwni ng  up  (24)-(27),  we  see  that  there  exists  constants  >  0,  >  0 

depending  only  on  e,  such  that 

2 

nnn  <  5  (n,b)  <  n0n*  b  e  B  .  (28) 

I  —  ~  ““  L  ~  £ 
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i 


n 


To  simplify  the  wording,  in  the  sequel  the  symbol  c  will  be  used 
to  denote  any  positive  constant  not  depending  on  b,  n,  which  piay  assume 
different  values  on  each  of  its  appearances,  and  the  phrase  "for  n  large" 
means  that  "for  n  larger  than  some  nQ  independent  of  £  e  B".  Since 
Qn(Y,b)  -  X2Nm(6^(n»b)) *  from  ^8)  and  Lemma  3,  we  obtain 

p(Qn(Y.b)/nN  >  1  +  n-,/2)  >  1  -  e'cn.  (29) 

Choose  h,  >  0  according  to  some  h  >  0  as  in  Lemma  2.  The  value  of  h  will 

.  .  2ph, 

be  specified  later.  Choose  a  subset  B  „  of  B  with  no  more  than  n 

en  e 

«• 

points,  such  that  for  each  b  e  B  ,  there  exists  b  e  B  such  that 
-h  G  -  en 

•  *1 

|b-b|  <  n  .  From  (44),  for  n  large,  we  have 
%  «  “  * 

p(  min  Q  (Y ,b)/nN  >  1  +  n,/2\  >  1  -  n^V0"  >  1  -  e"cn.  (30) 

\beB  n  n  “  1  J  ” 

-  en  / 

-h. 

Now  choose  arbitrarily  b  e  B  .  Find  b  e  B  such  that  |b-b|  <  n  . 

•  g  •»  e  n  •  « ' 


Consider 


J  =  |Qn(Y,b)  -  Qn(Y,b) 


Abbreviating  Bn(b),  Bn(b),  etc.  to  Bn,  Bn,  etc.,  we  have 


1  j  |x*(J»n)B*(0^  -  D~1)B|,Y(j,n) 
J  1 


*  ,L  r(j.n)5;5-'BnY(j,n)  -  f  U  ,n) 

0  ■ 


*  /  4  -  \  n* r\“  1  i 


=  J 1  +  ^2 • 
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By  (21 ) ,  we  have 


J,  i  l  ||B  Y(j,n)||2  <  n‘h  l  HP*l)|Yi(t>|‘. 

1  j=l  n~  j=l  t=0  3 

Put  s  =  max{^P=1 1  si  j  | :  j  =  1 .....  M ) .  Since  Ix^  =  ...  =  |xp|  =  1,  we 

have 


N  n-1 


l!lS1jX1 


is,  j  ■  1 


Hence, 


J.  <  n'h]2nN(p+l)s2  +  2  J  "j  (p  +  1 )  |e  ,(t)  |2 1 
/  j=1  t=0  3 


-h+1  .  „  -h 


N  n-1 


<  Cn-,,T'  +  Cn'"  J  l  |e.(t) |  . 

j=1  t=0  3 


(33) 


Introduce  the  event 


En=< 


By  (33) ,  we  have 


N  n-1 


l  Ile^Or  <2nN| 

j=l  t=0  J  \ 


EnC  J1  ic« 


-h+1 


(34) 


For  J2,  we  have 
N 


°2-  j)|!*(J’n)(^-Bn)5n,V-(J‘n> 


♦I  1*0  .h*®?;1  *■„  -  ®„>K  J  •»» 


J3  +  J4' 


(35) 


By  the  extended  Schwarz  Inequality, 


>*[ 

:w, 


J3  <  N  j  Y*(J  .")BXlBn!(j •">!*«  ■"> 1 K  ■  “A'  <Bn  '  Bn>-V» •"> 
J  * 

Write  w  =  3(p  +  l)2  +  1.  8y  (10),  (36),  we  have  for  n  large, 


fn*  n  \  rv  l  /  n 


j|i.N  J  n2w||SnY(j,n)|i2||(Bn-Bn)Y(j,n)||2 
iNn2**  J  ||BnY(j,n)H2  J  || (B„ -  BjYU.n) ||: 

J  “  1  j  **"  1 


In  the  course  of  proving  (33),  we  have  shown  that 


N  0  N  n-1  « 

l  l|BnY(j,n)||2  <  Cnt  C  l  l  |e  (t)|Z. 
j=l  n  j=l  t=0  J 


Further,  in  view  of  B  -  B  !  <  n  ,  we  have 

n  n1  — 


N  n-1 


II  *  O  o  n  •  i  i  o 

I  l!(Bn-Bn)Y(j,n)||2  <  n  ^p+l)2  l  l  |Y  (t)|2 

j=l  n  n  j=l  t=0  J 

-2h,+l  -2h,  N  n-1  ? 

<  Cn  1  +  Cn  1  l  l  |e.(t)|  . 

j=l  t=0  3 


From  (37)- (39) ,  we  see  that 


r  -(h,-w-lh 
E„  =  [J3  i  Cn  j- 


Likewise,  we  obtain 


r  -(h,-w-lK 

E„e[J4<Cn  j. 

Summing  up  (31),  (33),  (35),  (40)  and  (41),  we  obtain 

-  h+i  -h,+w+l 

E  c  (|Q  (Y,b)  -Q  (Y,b)|  <  Cn"n  1  +  Cn  1  >. 


\*  v:v  s*.  aSv' 


ba 

8 


I 

& 


Cc 


|B 

L 


$ 


& 


v 

***• 


Now  we  choose  h  ■  1.  Choose  h^  corresponding  to  this  h  according  to 
Lemma  2  such  that  h^  ^w  +  1.  For  this  choice  of  h  and  h-j ,  from  (30) 
and  (42),  we  get  for  n  large 

P(m1n  Qn(Y,b)/(nN)  >1  +  >  1  -  e"cn  -(l-P(En)).  (4: 

e 

On  the  other  hand,  since  Qn(Y,b^)  •  xj>nN  •  we  have  for  n  large, 

P(Qn(y.b(0))  <  1  +  n1/4)  >  1  -  e"cn.  (4- 

N  n  1  2  2 

Likewise,  since  Ij=1I Jig  I ej (t) 1  "XgpN*  we  have  for  n  large, 

P(En)  >  1  -  e‘cn.  (4! 

Summing  up  (43)- (45) ,  we  obtain  for  n  large, 

p(m1n  Q  (Y,b)  >  Qn(Y,b(0)))  <  e"cn. 

VbeB  n  n  / 


which  entails  (7),  and  the  theorem  Is  proved. 
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